To completely remove DWG references (xrefs) from your drawing, you need to detach them rather than erase them.

To completely remove xrefs from your drawing, you need to detach them. Erasing xrefs does not remove, for example, layer definitions associated with those xrefs. Using the Detach option removes the xrefs and all associated information.